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ABSTRACT - . . ^ „ , 

This evaluation report is a description of HomeworK 

Helpers, a program funded under the Elementary Secondary Education 
A.ct, Title I in nine 'non-public schools with disadvantaged 
youngsters. The two purposes of the program were to improve the 
competency of the students in reading and mathematics skills^ and 
increase student motivation and interest by developing positive 
attitudes toward self and school. Two hundred sixty students m 
grades twc through eight were recommended by Title I specialists in 
consultation with principals, ' teachers^ parents and pupils to receive 
.additional help in reading and mathematics. The project was conducted 
after school hours, two hours daily/ four days per week. High school 
tutors were instructed to encourage pupil self-confidence and to 
provide a" warm climate in which the students could perform freely, A 
student questionnaire consisting of twelve items explored attitudes 
toward' schccl, self, tutors, reading, and mathematics. The 
'questionnaire was given to the students twice as a pre-and 
post-evaluaticn. The results indicated that the students demonstrated 
considerable improvements in attitude toward self and school by the 
end of the program. The students reading and mathematics skills 
improved and were reflected in higher grade levels in those sub jects, 
A copy of the questionnaire used in the program evaluation is 
included in the appendix. (JP) 
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Chapter Ix THE PROGRAM 

Directed to students enrolled In the Title I Corrective 
Reading and Mathenatlos componentSt Hoaework Helpers was design- 
ed to provide Individualized tutorial assistance for those deem- 
ed in need of such added service. 

The HomeKork Helpers program Kas offered in nine non-pub- 
lic schools with, disadvantaged youngsters. Staffed by one mas- 
ter teacher t one educational assistant and a maximum bf ten high 
school student tutors t the project was conducted din'lng after- 
school hours t two hovirs daily » four days per vxeek. Some 260 
pupils in grades two through eight received help in reading and 
mathematics by way of the program. Participants were selected 
after recommendation by Title I specialists In cooperation with 
building principals and classroom teachers and in^ consultation, 
with parents and pupils. 

Homework Helpers had a dual purpose. First was to improve 
the competency of the children in reading and mathematics skills. 
In the main, these achievement . effects were accounted for in the 
Corrective Reading and Mathematics instructional components., se- 
cond was to increase pupil motivation and interest by developing 
positive attitudes toward self and school. To that end, partici- 
pants were given the opportunity to develop a. close relationship 
with older students who had been reasonably successful in school 
and could serve as competent models. Tutors were instructed to 
encourage pupil self-confidence gnd to provide a warm climate in 
which youngsters could perform freely. 

Because of late fundings the program was operational from 
November^ 197^ to '^une^ 1975* ' a ■ ' 



Chapter II: EVALUATION OBJECTIVES AND PROCEDURES 

6* The major academic achievement effects, as a result of 
services provided hj the Homework Helpers, are accounted for in 
the two main instructional components of Corrective Reading and 
Corrective Mathematics* 

6#1 Additionally, program personnel will develop a 
questionnaire on attitudes tovfards self and school, 
that have improved as a result of participation in 
this component. Program personnel will administer 
the questionnaire on a pre/post test basis. Improve- 
ment In these areas, based on questionnaire responses, 
will be analyzed qualitatively in narrative, desorip- 
tiye form. 

The following procedures were utilized to meet the above 
objective, as delineated In the Evaluation Design. After the 
program was finally approved, the coordinator in cooperation 
with project staff developed a student questionnaire consisting 
of twelve items that explored attitudes toward school, self, tu- 
tors, reading and mathematics. See Appendix for a copy of the 
instrument. Because of the lag in approval time and because of 
the time required for questionnaire production, it was not pos- 
sible to administer the device as a pretest until pebr\iary, 1975» 
With appropriate change in wording, the same questionnaire was 
given in June, 1975 as a posttest. The responses on both tests 
were tabulated by school, item number and subject area. Prom 
the data, totals, -means and mean differences were calculated for 
each school and for the population as a whole. An item analysis 
was made in order to facilitate describing gains qualitatively 
and in narrative form. 

With a view to assessing the extent and quality of pro- 
gram implementation, as described in the proposal and as recom- 
mended by the previous evaluator, the projbct vras closely moni- 
tored through site visits made at the opening and at the close 



-3- \ 



of the project year. Over the course of these\ visits, master 
teachers, educational assistants and tutors were^observed and 
Intervlov^ed In some depth. School administrators were consul- 
ted both In person and by telephone. Moreover, contacV^wlth 
the project coordinator was maintained at all times to se^re 
data on all aspects of program functioning. 

Chapter III: FINDINGS 

Evaluation Objective 6,1 . Essentially, the evaluation object- 
Ive of Homeworlc Helpers was to determine whether, as a result 
of participation In this component, enrolled pupils will de- 
monstrate an Improvement In attitudes toward self and school 
as measured by a questionnaire developed by program personnel. 

Table 1 constitutes a summary of the Item analysis of 
the questionnaire administered to all the children In the pro- 
graifl# The results Indicate that, compared with their attitudes 
at the start of the program, the youngsters demonstrated con- 
siderable Improvement In attitude toward self and school by 
the end of the project year. This finding Is underscored by the 
fact that, on the pretest, a total of 919 responses (357+562) 
shoYfed negative attitudes toward self and school; this was re- 
duced to 37 (I9+I8) in the posttest. Concurrently, positive at- 
titudes Increased from IO98 (^36+662) on the pretest to 2232 
(853+1379) on the posttest. 

/ Analysis of individual test items also showed significant 
* positive results. Host notevrorthy perhaps were the* large gains 
that occurred in liking the tutor (17^) • enjoying going to the 
Homework Helper Program (I5I). feeling the tutor liked the pupil 
(li^5), feeling the teacher liked the pupil (13^), liking to go 
Q to school (112). and enjoying reading (10?). Concurrently, large 
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declines were recorded In negative attitudes about all of the ^ 

Iteas on the test. | 

■ • • ( 
Table 2 is an analysis of the total and mean scoree On \ 

the questionnaire for each of - the nine schools In the progran 

and for the group- as a whole. It fehows clearly that not only 

did the entire group Improve considerably In attitude toward self 

and school but that every school In the program did so as well. 

TABLE 1: Item Analysis of the Results of the Questionnaire, 
with total responses for each Item. 



Never Seldom Soraetimes Often Always" 
ITEMS TEST 1 2 3 h S DIFP' 



• I like going to school. 








6y . 






]■ 2 












liU 


• I feel I do good work in 


Pre 


16 


6^ 




3^ 




100 


school* 


Post 


3 


1 


50 


. 79 


93 


• I feel smart in school, • 


pre 


. ho 


56 


lOi 


20 


— 2r-^ 


69 


Post 


1 


.1 


59 


79 


1 66 


• I foel my teacher likes 
mo* 


tPre 


?2 


26 




41 


1 70 j 


. 134 






\ 






1 — 127 


• I enjoy going to the 
Homewoi^k Helper Progran. 


Pre 


21 


?2 


63 


43 


S 100 


151 


Post 


1 


1 


1? 


5S 


i 146 


• I like my tutor. 


Pre 


la 1 17 


70 


36 


1 112 


174 


Post 


2 1 1 


15 


5^ 1 


! 155 


• I feel my tutor likes mo 


Pre 


! 1 n 1 


82 






\ 145 


Poso* 




• 31 






• I feel I can do ray own 
work in reading. 


pre 


33 


69 


91 


30 


■ 32 1 


j 82 


Post 


0 


2 


37 


85 


99 ! 


• .1 feel I can do my^own 
work in mathematics. 


Pre 


39 


63 


93 


33 


27 


79 


Post 


0 


2 


46 


68 


113 


. I foel I can do my 
homework well. 


rre 






I 9V . 


'^'/ 


3U 


73 


Post 


0 


0 


1 52 


1 79 


96 


. I enjoy reading. 


[Pre [ 30 










1 107 


iPostJ 0 










. I enjoy doing nathenatic 






55 


86 


3J 




87 


Post 




5 


26 


_ 73 


112 


TOTALS 


tPro 




562 


10i^4 




602 


1313 


Pq^st 




__16 




653 


1379 



jr DIFF = Posttest Responses (4 + 5) - Pretest Responses (1 + 2) 



TABLE 2: Results of the Questionnaire for each School 



SCHOOL NUMBER 
ANTD NAME 


TEST 


Pupil 
Nunber 


Total ^ 
Score ^ 


Mean 


Mean Dlff , 


1, Fort Greene 


Pre 
Post 


29 

2b 


1219 
1^99 


42.03 
53.53 


11.5 


2, St, Brigld 


Pre 
^st 


31 

U 


1156 
650 


37.29 
50.0 


12.71 


3. our Lacly of 
sorrows 


Pre 
Zost 


26 
25 


991 
1281 


38.11 
51.24 


13.13 


Sacred Heart 


Pre 
£o^t 


30 


1270 
1811 


42.33 
53.26 


10.93 1 


5. our Lady of 
Peace 


Pre 
Post 


23 
23 


784 
1155 


34.08 
50.21 


16.13 


6, Ye Shiva Karlln 


Pre 
Post 


31 
29 


1182 
13'+o 


38.12 
46.48 


8.36 


?• Bnos Jacob 


Pre 

. Post- 


2^ 
18 


-1122 
1004 


46.75 
55.77 


9.02 


8^ Bobover 


Pre 
Post 


2S 


1041 
2140 


27'. 39 
53.50 


26.11 


9. Beth Jacob 


Pre 
Post 


23 
18 


914 

838 


39.73 
46.55 


6.82 


' TOTALS 


Pre 
Post 


259 
228 


9667 
11726 


37.32 
51.42 


14.10 



Evaluation Objective 6. Ths raajor academic achievement effects, 
as a result of services provided by honevrork helpers » are accounted 
for In the two main Instructional components of Corrective Reading 
and Corrective Mathematics. 

Some -Indication of the Impact of Homowork Helpers on the 
other two components is afforded by the ^ following letter received 
by one master teacher from a colleague in in the Title 1 Corrective 
Reading Program, dated April 30, 1975. '; 
Dear Surl, 

■ ■ ■ ■■ .' 

The work you're doing with the girls 1^ getting 

results! .vt^-' 

^ '■ '•' I- 

If the post- tests mean anything, Impjrovement was 
ehovm'ln those skills that you were woriclng on with 
Individuals. For example, you were wording vxlth 
I,B. on main Ideas. She went up 2 yearis (I mean 
her grade level went up 2 years) In literal compre- 
hension. 

I thought you'd be glad to know. 
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Yours, 
Judy 
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Flncllngs Concerning Tutors : ^ 

Near the termlnatloiii of the project year, a total of 78 
tutors were asked to rate the program In terms of their own at- 
tltudcs. The purpose na's to verify the findings relative to the 
attitudes expressed on the student questionnaire and to seek In- 
formation on related matters. The largest number of tutors said 
they liked the program very much this year (66), a finding which 
coincided closely with that of their pupils. Similarly, 66 tutors 
(84^) stated they liked their students and 57(73^) believed that 
their students liked them. This result compared favorably with 
the ^Z% of the youngsters who said they liked their tutors and 
the 86^ who felt their tutors liked them. Of the entire group 
of tutors/ 51 stated that the master teacher and the educational 
assistant helped them a great deal this year while ^7 thought 
their pupils liked coming to Homevfork Helpers after school very 
much. In all, ^70 strong positive responses were obtained about 
the program compared with 16 strongly negative ones. 

Purtheimore, an effort was made by the evaluator to elicit 
from the tutors extended answers on other matters related to the 
program. On the subject of what helped the pupils most, the con- 
sensus was that encouragement, attention and praise - positive re- 
inforcement - was most effective. Of rather lesser significance 
was explaining their work to them and discussing the importance 
of education. Qnly two tutors^ saw fit to mention becoming a friend 
rather than a tutor to their students. On the matter of constraints 
iaost felt they had no problems; of those who had problems, lack of 
enough and proper materials was mentioned most frequently,. Two 
others were Insufflolent time and irresponsible pupil behaviors. 

o 9 



in addition to gaining oxperience in teaching, a substantial 
nximber of tutors felt they grew In understanding of and having 
patience with children. ^ smaller number said they got a feel- 
ing of satisfaction In helping the youngsters. Finally and un- 
fortunately, no new Ideas for Improving the; Homework Helpers 
program emerged from the tutors. ^ 

Flndlng;s Durlnfic Site Visits ; 

Eight of the nine building principals were interviewed 
at the close of the project year. The consensus was that they 
were quite pleased with the program this year, that the child- 
ren were generally working diligently on visits to the centers, 
that the youngsters seened to be progressing well in their stu- 
dies and that they have a more positive attitude to school. 
When pressed for details of their perception of the project, 
most said that it supplements and reinforces the regular day 
school program and that its emphasis is on helping the children 
with their homework. Some were aware that its major thrust was to 
supplement the Title I program and it had no direct relationship 
to classroom homework. Two v?e:?e concerned about pupil atten- 
dance at the centers and one had reservations about the program 
coordinator in terms of lateness of supplies and failure to make 

a sufficient number of visits. 

Observed by the evaluator at each center were small clusters 

consisting of' one tutor with from ono-to-thrce pupils seated at a 
t?blG or dook, usually in a large room such as a lunchroom. For 
the most part, master teachers or educational assistants circula- 
ted to offer suggestions or check on progress. Available to tu- 
tors were pupil folders with intcrcomponcnt recommendations in 

10. 
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whloh they wrote comments, some of which were Just begun or were 
seriously out-of-date. The Instructional materials varied from 
many to few; from appropriate to inappropriate* By and large, 
tutors seemed to be occupied with textbooks, helping the child- 
ren with their homework. Seldom, If ever, did tutors appear to 
be aware of or working with diagnosed pupil weaknesses In read- 
ing and mathematics or engaged In treating such weaknesses spe- 
cifically. In at least one school, attendance was observed to 
be far below enrollment. 

Moreover, In terms of Implementation of the program as 
it appears in the proposal, the operation was somevrhat deficient. 
There was little articulation with the Title I instructional 
components as regards workshops, nor was a diagnostic-prescrip- 
tive approach readily apparent. In addition, classroom teachers 
did not meet vrith tutors at all, much less at frequent intervals 
as stated l^s the proposal, . Th^e is no evidence that tutors kept 
pupil work folders which were Inspected "vzeekly, which contained ^ ' 
suggestions for planning and which featured an ongaing evalua- 
tlon of the pupil's progress, At the termination of the^program, 
no center had ten tutors; Indeed, one had as few as^slx. 

On the other hand, the previous eval.ua tor had made a large 
number of suggestions most of vrhich had. been carried out: 1) ma- 

y 

ster teachers were makirtg a deterTalned effort to schedule an equal 
amount of help in reading and mathematics for those children in 
need of both; 2) by the ^ricL of this project yeair more materials 
had arrived at all qefiters, although they wpf e still far from suf- 
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ficient, appropriate or stimulating; 3) basic supplies were 
available at all centers; 4) required attendance of at least 
four hours per week was iirplemented; 5) centers started 

daily immediately after school; 6) tutors were paid promptly; 
7) records of attendance were maintained on a daily basis by 
educational assistants and records of dally work was kept by 
tutors; 8) either the master teacher or the educational assis- 
tant ^^orked in or was connected with the site, school during 
the day; 9) almost all tutors had previous experience working 
with children; 10) letters were prepared and distributed in 
order to communicate vxith parents; 11) master teachers were 
rated by tutors and others; 12) the program was expanded to 
include nine schools; and 13) an effort was made to publicize 
the program. 

Findings During Conferences ; 

Following the observations, conferences were held with 
all master teachers in the field, usually attended by the edu- 
cational assistants. Based on a prepared form, responses were 
sought regarding their opinions, problems and suggestions. 

/"^ Asked to rate various aspecta of the progrjim on a scale 
from l(lowest) to 5 (highest), the master teachers gave the 
highest score to the educational assistants (mean = ^,88); se- 
cond was the time allotted to pupils for instruction. Lovxest 
rating was accorded the tutor training program with a mean 
score of 3.83, Intermediate ratings were attained by the tu- 
tors themselves, who scored 4.05 on the average, and instruc- 
tional materials -which achieved a mean score of 4.25, 

ERIC 
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Viewing the Honevrork -Helper Program in Its entirery, 
the master teacVier^ gave It a mean score of ^•33i one- third 
the way between good and very good.' Advanced as reasons for 
the rating was the positive feedback from parents and class- 
room teachers as well aa the fact that they had observed much 
pupil progress for themselves. 

Problems and Sut^ic^estions ; 

By far the most pressing problem expressed by the master 
teachers was the ' Inadequacy of the instructional materials and 
the tlae It took then to arrive. As a group, they suggested that 
the program be funded early so as to allow sufficient time to con- 
fer, plan, select pupils, train tutors,, obtain materials and ini- 
tiate the program quickly. They favored a uniform set of records 
simplified papervrork and having the coordinator more directly in- 
volved with the program at the centers. Among the interesting 

■ideas that emerged were using older tutors .(one middle-aged woman 
was doing extremely vrell)-, having witten guidelines prepared by 

•the coordinator, employing separate sound-proofed rooms for tutoi 
ing and raising the image of the program by permitting better 

.J 

students to enter up to a limit of ZS% of the total. 

In air fairness, it must be noted that many of the problems 
could have been avoided if the program had been funded earlier in 
the school year. 



Chapter IV: SUMIIARY OF MAJOR FINDINGS, CONCLUSIONS AND ,. 
RECOiMMENDATIONS 

By all accoiints, the Homework Helpers Program has achieved 
Its major objective of Improving the attitude of participants to- 
ward school and self. Additionally, It has been of some assist- 
ance to the corrective Reading and Mathematics components In at- 
taining their objectives. All who were consulted - administrators, 
master teachers, educational assistants, tutors and pupils alike - 
were positively disposed toward the program. Based on these find- 
ings, it may be said that the project should be recycled. 

Nevertheless, certain flaws do exist in its implementa- 
tion: a) because of late fvmding and resultant staffing problems, 
several centers were, remiss in executing it precisely as it ap- 
pears in the proposal; b) building administrators and others 
gave the distinct impression that the thrust of the program was 
merely to help youngsters do their homework, rather than viewing 
it as supportive of Corrective Reading and Mathematics; c) tutors 
have demonstrated an iirgent need to be trained in using a diagnos- 
tic, varied and stimulating approach to teaching their charges; 

d) overall supervision .requires strengthening to improve atten-% 
dance, articulate with other components and maintain records and 

e) materials were so Inadequate or inappropriate that they were 
infrequently utilized. Accordingly, if the program is to be re- 
newed, it is recommended that: 

1, It be funded as ^arly as pos.slble in order to prevent the 
problems that arose during the current school year. Early 
funding should provide the time to secure adequate and ap- 
propriate materials, recruit competent staff, facllita.te ■ 
full Implementation of the proposal, obtain diagnostic in- 
formation through articulation with other components and 
involve parents more directly in the program. 

14 
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2. Befare commencement of the program In the fall, schedule 
an orientation period of several days to take place at 
central office and at the feltes, consisting of conferences 
and workshops. Among the possible purposes could be to 
review the proposal for full Implementation, plan pre- 
scriptions for treatment of pupil deficits, set up a uni- 
form system of records, train tutors and exchange Ideas, 
methods and products. 

3. Change the perceived Image of the project by altering Its 
name and by publicizing Its true goals. Some titles for 
consideration are After-School Club, Afternoon Helpers, 
Tutorial Centers and the like. Each master teacher should 
be charged vriLth the prime responsibility for Informing 
principals and others of program objectives and activities. 
Related' publicity should stress the pos;ltlve aspects and 
unique benefits of the program. 

4. To improve overall supervision, one or more of the follow- 
ing should prove helpful: a) reduce the number of centers 
to six or seven to permit more frequent visitation and 
service; b) employ a part-time trainer to assist at cen- 
ters as required; c) plan frequent and regular visits to ' 
sites to monitor progress and to help with problems; d) 
write written reports following all visits and follow up ' 
on recommendations; e) Inspect all pupil, tutor and center 
records during eacii visit and f) provide for intervlsita- 
tlon to well- functioning centers as needed. 

5. With the aid of master teachers, consider developing a 
handbook or set of guidelines for proper operation of a 
center. A document of this sort could be extremely help- 
ful to nei^ staff and others in need of guidance. 
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Measures of growth other than Standardized Tests 
30D 



Function # 09-59633 
Homework Helpers 



This question is designed to describe the attainment of approved objectives 
not normally associated with measurement by norm referenced standardized 
achievement tests. Such objectives usually deal with behavior that is 
l,,directlv observed, especially in the affective domain. For example, a 
reduction in truancy, a positive change in attitude toward learning, a 
reduction in disruptive behavior, an improved attitude toward self (as 
indicated by repeated interviews), etc., are frequently held to be prerequisite 
to the shift toward increased academic achievement by disadvantaged learners. 
Where your approved measurement devices do not lend themselves to reporting on 
tables 30A, B or C, use any combination of items and report on separate pages. 
Attach additional pages if necessary. 



r 



ComDonent Code 



Activity Code 



Objective/ Code 



6 


0 


8 


2 





8 



52 



, , The twelve-item questionnaire was des'.<::v:A by 

Brief Description 1 — ~- 

Staff to determine degree of improvement in attitude tu .rd 
school and s elf. It was administered at the nine centers to 
s-DUdents who were asked to rate each item by checking tlte 
proper colum ns The scale was tallied by master teachers who 
retu-y^ned it to the coordinator, ' ' 



Number of cases observed: 





2 


2 


8 



Number of cases in treatment: 



8 



Pretreatment index of behavior (Specify scale used): The scale yanged 



from 1 (Never) to 5 (/^Iw^ays) for, each item. Expected Pretreat- 
ment index was mainly at the . 1 - 2 level of behavior; at the 



Posttreatment, the index was expected to rise to the ^ - 5- level 
on the average. ^ ^ ^ 



Improvement from Pretest to Posttest, as 
Criterion of success: 

described in the Evaluation Design. 



was objective fully n,et7 Yes [El No □ " • by .w-fiSTVuerla do, you 

know? The mean scores for all indivi dual items and /for the 

" ' ~~ ^ 

test as a whole shifted to the upper end of the scaleV 



Comments 



TF 
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STUDENT QUESTIONNAIRE 
Post-Test . 



Strident »s Initials ^ Age ^Sex 

Schoo l . . _^Grade Date 

Student Is being tutored in reading ^mathematics 



Boys and Girls, 

This questionnaire will help your tutors to deterroina whether 
or not they have helped you in the Homework Helper Program, Please 
answer every question as well as you can. 

PLACE A CHECK IN THE COLUMN WHICH YOU THINK ANSWERS THE QUESTION 
BEST. 

Never Seldom Sonetim;..; Often Always 



1 2 5 h S 



■ 

SINCE I HAVE BEEN ATTEITOING 
THE HOMEWORK HELPER PROGRAM: 




1 1 11 

1. I like going to school. 










- 


2. I feel I do good work in 
school. 












3. i feel smart in school. 












1|. I feel my teacher likes me. 












5. I enjoy going to tho 

Homework Helper Program ^^^^ 








, 1 




6. I like my tutor. 












7. I feel my tutor likes me. 












8. I feel I can do ray own 
work in reading. 












9« I feel I can do my own 
work in mathematics. 












1*6. I feel I can do my 
homework well. ■ " ^ 




^- 1 








11. I enjoy reading. 




1 






12. I enjoy dping mathematics. 
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